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In  the  mid-1990s,  the  Washington  State  Legislature 
first  began  to  direct  the  Washington  State  Institute 
for  Public  Policy  (Institute)  to  identify  “evidence- 
based”  policies  that  have  been  shown  to  improve 
particular  outcomes. 

The  motivation  for  these  assignments  is 
straightforward:  to  provide  Washington  policymakers 
and  budget  writers  with  a  list  of  well-researched 
policies  that  can,  with  a  high  degree  of  probability, 
lead  to  better  statewide  results  and  a  more  efficient 
use  of  taxpayer  dollars. 

This  short  report  provides  a  snapshot,  as  of  April 
2012,  of  our  current  list  of  evidence-based  policy 
options  on  many  public  policy  topics.  Where  possible, 
we  provide  an  independent  assessment  of  the 
benefits  and  costs  of  each  option  from  the  perspective 
of  Washington  citizens  and  taxpayers. 

In  essence,  this  report  is  similar  to  an  investment 
advisor’s  “buy-sell”  list — it  contains  current 
recommendations  on  policy  options  that  can  give 
taxpayers  a  good  return  on  their  investment  (“buys”), 
as  well  as  those  that  apparently  cannot  (“sells”). 

This  report  replaces  previously  published 
Institute  reports  on  these  topics. 

We  will  occasionally  add  or  update  results  for 
individual  policy  options  on  our  website  as  new 
information  becomes  available.  Exhibit  1  of  this 
report  includes  hyperlinks  to  detailed  results  for  each 
program. 


Suggested  citation:  Lee,  S.,  Aos,  S.,  Drake,  E.,  Pennucci,  A., 
Miller,  M.,  &  Anderson,  L.  (2012).  Return  on  investment: 
Evidence-based  options  to  improve  statewide  outcomes, 
April  2012  ( Document  No.  12-04-1201).  Olympia: 
Washington  State  Institute  for  Public  Policy. 


Background 

The  Institute  was  created  by  the  1983  Washington 
Legislature  to  carry  out  non-partisan  research  at 
legislative  direction. 

The  1997  Legislature  directed  the  Institute  to  review 
“evidence-based”  policy  strategies  in  juvenile  justice 
and  adult  corrections.  We  identified  several  programs 
that  had  been  tried  and  evaluated  elsewhere  but  were 
not  then  operating  in  Washington.  We  found  that 
some,  but  not  all,  programs  had  the  potential  to 
reduce  crime  and  save  Washington  taxpayers 
money.1  In  subsequent  sessions,  the  legislature  used 
the  information  to  begin  a  series  of  policy  reforms.2 
Many  practical  lessons  have  been  learned  about  how 
to  implement  these  programs  with  fidelity  statewide.3 

Based  on  this  initial  success,  in  the  early  2000s  the 
legislature  began  to  direct  the  Institute  to  apply  the 
same  evidence-based  and  benefit-cost  approach  to 
other  public  policy  areas,  including  K-12  education, 
early  childhood  education,  prevention,  child  welfare, 
mental  health,  substance  abuse,  and  public  health.4 

In  this  report,  we  discuss  our  research  approach  and 
summarize  our  current  results  on  these  topics. 

General  Research  Approach 

As  we  have  carried  out  these  legislative  assignments, 
we  have  been  implementing  a  three-step  research 
approach. 

1)  We  systematically  assess  evidence  on  “what 
works”  (and  what  does  not)  to  improve  outcomes. 

2)  We  calculate  costs  and  benefits  for 
Washington  State  and  produce  a  ranking  of 
public  policy  options. 

3)  We  measure  the  riskiness  of  our  conclusions 
by  testing  how  bottom  lines  vary  when 
estimates  and  assumptions  change. 

A  brief  description  of  each  step  follows. 
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Step  1 :  What  Works?  What  Doesn’t? 

In  the  first  research  step,  we  estimate  the  probability 
that  various  policies  and  programs  can  improve 
outcomes.  Once  the  legislature  has  indicated  an 
outcome  of  interest,  we  then  carefully  analyze  all 
high-quality  studies  from  the  United  States  and 
elsewhere  to  identify  well-researched  policy  options 
that  have  achieved  the  outcome  (as  well  as  those 
that  have  not).  We  look  for  research  studies  with 
strong  evaluation  designs;  we  ignore  studies  with 
weak  research  methods.  Our  empirical  approach 
then  follows  a  meta-analytic  framework  to  assess 
systematically  all  credible  evaluations  we  can  locate 
on  a  given  topic.  We  produce  an  estimated  effect  of 
a  policy  on  a  particular  outcome  of  interest,  as  well 
as  an  estimate  of  the  margin  of  error  in  that  effect. 

Step  2:  What  Makes  Economic  Sense? 

Next,  we  insert  benefits  and  costs  into  the  analysis 
by  answering  two  questions. 

s  How  much  does  it  cost  to  produce  the  results 
found  in  Step  1  ? 

S  How  much  is  it  worth  to  people  in  Washington 
State  to  achieve  the  outcome?  That  is,  in  dollar 
and  cents  terms,  what  are  the  program’s  benefits? 

To  answer  these  questions,  we  have  developed — 
and  we  continue  to  refine — an  economic  model  that 
assesses  benefits  and  costs.  The  goal  is  to  provide 
an  internally  consistent  monetary  valuation  so  that 
one  option  can  be  compared  fairly  to  another.  Our 
bottom  line  benefit-cost  measures  include  standard 
financial  statistics:  net  present  values,  benefit-cost 
ratios,  and  rates  of  return  on  investment. 

We  present  these  monetary  estimates  from  three 
distinct  perspectives:  the  benefits  and  costs  that 
accrue  solely  to  program  participants,  those 
received  by  taxpayers,  and  those  received  by  other 
people  in  society  (for  example,  crime  victims). 

The  sum  of  these  three  perspectives  provides  a  “total 
Washington”  view  on  whether  a  policy  or  program 
produces  benefits  that  exceed  costs.  Our  model  can 
also  restrict  the  focus  solely  to  the  taxpayer 
perspective  which  can  be  useful  for  fiscal  analysis  and 
state  budget  preparation. 

Step  3:  Assessing  the  Riskiness  of  the 
Estimates. 

The  third  analytical  step  involves  testing  the 
robustness  of  our  results.  Any  tabulation  of  benefits 
and  costs  involves  some  degree  of  speculation 
about  future  performance.  This  is  expected  in  any 
investment  analysis,  whether  it  is  in  the  private  or 
public  sector.  To  assess  the  riskiness  of  our 


conclusions,  we  perform  a  “Monte  Carlo  simulation” 
in  which  we  vary  the  key  factors  in  our  calculations. 
The  purpose  of  the  risk  analysis  is  to  determine  the 
odds  that  a  particular  policy  option  will  at  least  break 
even.  This  type  of  analysis  is  used  by  many 
businesses  in  investment  decision  making. 

Thus,  for  each  option,  we  produce  two  “big  picture” 
findings:  expected  benefit-cost  results  (net  present 
values  and  rates  of  return)  and,  given  our 
understanding  of  the  risks  involved,  the  odds  that 
the  policy  will  at  least  have  benefits  greater  than 
costs. 

Changes  Since  the  July  2011  Update 

Since  the  Institute’s  benefit-cost  findings  were  last 
published  in  July  201 1 ,  several  findings  have 
changed  substantially,  due  to  improvements  in  our 
benefit-cost  methodology.  The  changes  affect  our 
previous  results  in  two  major  ways,  one  that  affects 
a  particular  topic  area,  and  another  that  cuts 
across  all  topic  areas. 

First,  we  changed  the  method  by  which  we 
monetize  children’s  mental  health  disorders  to  more 
closely  match  the  methods  we  use  to  monetize 
adult  mental  health  disorders.  The  benefit-cost 
model  is  now  able  to  distinguish  between  the  effects 
of  preventing  disruptive  behavior  disorders 
compared  to  the  effects  of  treating  youth  who 
already  have  these  disorders.  The  effect  of  this 
modeling  change,  relative  to  our  July  201 1  findings, 
lowers  the  expected  benefits  of  programs  that  affect 
child  externalizing  behaviors. 

Second,  we  have  updated  our  methods  to  avoid 
“double  counting”  benefits  from  a  single  monetary 
source.  For  instance,  a  program  evaluation  that 
measures  high  school  graduation  rates,  test 
scores,  and  disordered  alcohol  use  would  be 
monetized,  in  part,  via  changes  to  lifetime  earnings 
in  the  labor  market  from  each  of  these  outcomes. 

In  the  former  version  of  our  model,  to  avoid  double 
counting,  we  allowed  the  highest  of  these  three 
values  to  “trump”  the  other  values.  We  discovered 
that,  in  a  Monte  Carlo  simulation,  consistently 
selecting  the  highest  of  the  three  values  biased  the 
results  in  a  positive  direction,  and  may  not  have 
accurately  represented  the  expected  monetary 
benefits  of  a  policy.  Thus  our  prior  trumping 
method  favored  policies  that  measured  multiple 
outcomes  in  their  evaluations;  for  example,  the 
more  ways  a  study  measured  impacts  on  labor 
market  earnings,  the  more  likely  our  previous 
model  would  have  estimated  a  positive  overall 
benefit. 
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In  the  current  update,  we  have  improved  our  trumping 
method  by  taking  a  weighted  average  of  all  outcomes 
that  derive  benefits  from  a  single  monetary  source. 
Using  the  new  method,  we  more  accurately  represent 
the  expected  benefits  from  programs  that  measure 
multiple  outcomes.  This  modeling  change  lowered 
the  estimated  benefits  of  a  number  of  programs  that 
measured  certain  monetary  benefits  through  multiple 
outcomes. 

For  more  detail  on  these  modeling  changes,  see 
the  technical  appendix.* 2 3 4 5 

April  2012  Results 

In  this  report,  we  summarize  our  results  in  a 
Consumer  Reports- like  list  of  what  works  and  what 
does  not,  ranked  by  benefit-cost  statistics  and  a 
measure  of  investment  risk.  We  identify  a  number  of 
evidence-based  options  that  can  help  policy  makers 
achieve  desired  outcomes  as  well  as  offer  taxpayers 
a  good  return  on  their  investment,  with  low  risk  of 
failure.  Washington  is  already  investing  in  several  of 
these  options.  We  also  find  other  evidence-based 
options  that  do  not  produce  favorable  results. 

In  Exhibit  1 ,  we  have  arranged  the  information  by 
major  topic.  Some  programs  listed,  of  course,  achieve 
outcomes  that  cut  across  these  topics.  The 
documents  hyperlinked  to  the  program  titles  in  this 
exhibit  provide  comprehensive  outcome  information. 

For  some  programs,  insufficient  information  was 
available  to  allow  a  calculation  of  benefits  and  costs. 
We  list  these  programs  in  each  topic  area,  along  with 
the  reason  for  their  exclusion. 

Example:  How  to  Read  Exhibit  1. 

To  illustrate  our  findings,  we  summarize  results  for  a 
program  called  Functional  Family  Therapy  (FFT), 
designed  for  juveniles  on  probation.  This  program  is 
listed  under  the  topic  of  juvenile  justice  in  Exhibit  1 . 

FFT  was  originally  tested  in  Utah;  Washington  began 
to  implement  the  program  in  the  mid-1 990s.  The 
legislature  continues  to  fund  FFT,  and  it  is  now  used 
by  many  Washington  juvenile  courts. 

We  reviewed  all  research  we  could  find  on  FFT  and 
found  eight  credible  evaluations  that  investigated 
whether  it  reduces  crime.  The  appendix  linked  in 
Exhibit  1  provides  specific  information  on  the  eight 
studies  in  our  meta-analysis  of  FFT. 

•  In  Exhibit  1 ,  we  show  our  estimate  of  the  total 
benefits  of  FFT  per  participant  (201 1  dollars). 

These  benefits  spring  primarily  from  reduced  crime, 
but  also  include  labor  market  and  health  care 
benefits  due  to  increased  probability  of  high  school 
graduation. 


•  Of  the  total  benefits,  Exhibit  1  shows  that  we  expect 
some  to  be  received  by  taxpayers  and  the  majority 
to  accrue  to  others,  including  the  participants  and 
people  who  were  not  victimized. 

•  Exhibit  1  also  shows  our  estimates  of  the  program 
costs  per  participant  in  Washington. 

•  The  columns  in  the  right-hand  side  of  Exhibit  1 
display  our  benefit-cost  summary  statistics  for  FFT. 
We  show  the  net  present  value  (benefits  minus 
costs),  and  the  benefit-to-cost  ratio.  Finally,  we 
show  the  results  of  a  risk  analysis  of  our  estimated 
bottom  line  for  FFT. 

•  Based  on  these  findings,  one  would  conclude  that 
FFT  is  an  attractive  evidence-based  program  that 
reduces  crime  and  achieves  a  favorable  return  on 
investment,  with  a  small  chance  of  an  undesirable 
outcome.  These  are  the  central  reasons  why  FFT 
continues  to  be  part  of  Washington’s  crime- 
reduction  portfolio. 

In  addition  to  the  summary  information  displayed  in 
Exhibit  1 ,  we  have  prepared  supplementary  documents. 
The  individually  linked  documents  provide  detailed 
results  for  each  option  summarized  in  Exhibit  1 ,  while 
the  technical  appendix  provides  a  comprehensive 
description  of  the  research  methods  used  to  compute 
the  results. 
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Exhibit  1 

Monetary  Benefits  and  Costs  of  Evidence-Based  Public  Policies 

Summary  of  policy  topics  assigned  to  the  Washington  State  Institute  for  Public  Policy  by  the  Washington  State  Legislature 

Estimates  for  Washington  State ,  as  of  April  2012 


Topic  Area/Proaram 

Last 

Monetary  Benefits 

Costs 

Summary  Statistics 

Benefits  and  costs  are  life-cycle  present-values  per  participant,  in  201 1 

Updated 

Total 

Taxpayer 

Non- 

Benefits 

Benefit  to 

Measured 

dollars.  The  programs  are  listed  by  major  topic  area,  although  some 

Benefits 

Taxpayer 

Minus 

Cost 

Risk 

programs  achieve  benefits  in  multiple  areas.  Also,  some  programs  achieve 

Costs 

Ratio1 

(odds  of  a 

benefits  that  we  cannot  monetize;  see  linked  documents  for  program- 

(net  present 

positive  net 

specific  details. 

value) 

present  value) 

Juvenile  Justice 

Functional  Family  Therapy  (Institutions2) 

April  2012 

$70,370 

$14,476 

$55,895 

($3,262) 

$67,108 

$21.57 

100% 

Aaaression  Replacement  Trainina  (Institutions) 

April  2012 

$62,947 

$12,972 

$49,976 

($1 ,508) 

$61,440 

$41 .75 

94% 

Multidimensional  Treatment  Foster  Care 

April  2012 

$39,197 

$8,165 

$31,032 

($7,922) 

$31,276 

$4.95 

85% 

Functional  Family  Theraov  (Probation) 

April  2012 

$33,967 

$8,052 

$25,916 

($3,261) 

$30,706 

$10.42 

100% 

Aaaression  ReDlacement  Trainina  (Probation) 

April  2012 

$31 ,249 

$7,423 

$23,826 

($1,510) 

$29,740 

$20.70 

96% 

Multisvstemic  Therapy  (MST) 

April  2012 

$32,121 

$7,138 

$24,983 

($7,370) 

$24,751 

$4.36 

98% 

Family  Intearated  Transitions  (Institutions) 

April  2012 

$28,137 

$5,751 

$22,386 

($11,219) 

$16,918 

$2.51 

91% 

Druq  Court 

April  2012 

$13,667 

$3,084 

$10,583 

($3,091) 

$10,576 

$4.42 

94% 

Coordination  of  Services 

April  2012 

$5,501 

$1,412 

$4,089 

($395) 

$5,106 

$13.94 

82% 

Victim  Offender  Mediation 

April  2012 

$4,205 

$1,080 

$3,125 

($579) 

$3,626 

$7.27 

95% 

Scared  Straiaht 

April  2012 

($4,949) 

($1,271) 

($3,678) 

($65) 

($5,014) 

($76.35) 

0% 

Juvenile  justice  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time) 

Cognitive  Behavioral  Therapy  (general) 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Diversion  Programs 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Juvenile  Boot  Camps 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Supervision  for  Juvenile  Offenders 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Sex  Offender  Treatment  for  Juvenile  Offenders 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Team  Child 

October  2006 

See  previous  WSIPP  publication  for  past  findinas. 

Teen  Courts 

October  2006 

See  previous  WSIPP  oublication  for  past  findinas. 

Wilderness  Challenge  Programs 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Adult  Criminal  Justice 

Offender  Re-entrv  Community  Safety  Proaram  (danaerouslv 

mentally  ill  offenders) 

April  2012 

$70,535 

$18,120 

$52,415 

($32,247) 

$38,288 

$2.19 

100% 

Drua  Offender  Sentencina  Alternative  (drua  offenders) 

April  2012 

$22,365 

$5,318 

$17,047 

($1 ,542) 

$20,823 

$14.51 

100% 

Supervision  with  Risk  Need  and  Responsivitv  Principles 

(hiah  and  moderate  risk) 

April  2012 

$24,203 

$5,817 

$18,386 

($3,543) 

$20,660 

$6.83 

100% 

Correctional  Education  in  Prison 

April  2012 

$21 ,426 

$5,238 

$16,188 

($1,128) 

$20,298 

$19.00 

100% 

Electronic  Monitorina  (radio  freauencv  or  alobal  positioning  systems) 

April  2012 

$18,745 

$4,438 

$14,307 

$1,067 

$19,812 

n/e 

100% 

Vocational  Education  in  Prison 

April  2012 

$20,446 

$5,017 

$15,429 

($1,571) 

$18,875 

$13.01 

100% 

Mental  Health  Courts 

April  2012 

$20,424 

$4,998 

$15,425 

($2,935) 

$17,488 

$6.96 

100% 

Drua  Treatment  in  the  Community 

April  2012 

$17,711 

$4,206 

$13,504 

($1 ,602) 

$16,108 

$11.05 

100% 

Druq  Courts 

April  2012 

$15,433 

$3,376 

$12,057 

($4,178) 

$11,255 

$3.69 

100% 

Drua  Treatment  in  Prison 

April  2012 

$15,577 

$3,834 

$11,743 

($4,603) 

$10,974 

$3.38 

100% 

Drua  Offender  Sentencina  Alternative  (DroDertv  offenders) 

April  2012 

$11,273 

$2,666 

$8,607 

($1 ,540) 

$9,733 

$7.32 

78% 

Coanitive  Behavioral  Theraov  (moderate  and  hiah  risk) 

April  2012 

$9,695 

$2,308 

$7,387 

($412) 

$9,283 

$23.55 

100% 

Intensive  Supervision:  With  Treatment 

April  2012 

$15,169 

$3,610 

$11,559 

($7,874) 

$7,295 

$1.93 

96% 

Work  Release 

April  2012 

$7,117 

$1,749 

$5,368 

($661) 

$6,456 

$10.77 

99% 

Correctional  Industries  in  Prison 

April  2012 

$7,042 

$1,713 

$5,329 

($1,417) 

$5,625 

$4.97 

100% 

Employment  T rainina/Job  Assistance  in  the  Community 

April  2012 

$5,501 

$1,311 

$4,190 

($135) 

$5,366 

$40.76 

100% 

Intensive  Supervision:  Surveillance  Only 

April  2012 

($578) 

($133) 

($445) 

($4,140) 

($4,718) 

($0.14) 

11% 

Domestic  Violence  Peraetrator  Treatment  Programs 

April  2012 

($4,908) 

($1,165) 

($3,742) 

($1 ,359) 

($6,266) 

($3.61) 

14% 

Adult  criminal  justice  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 

Adult  Boot  Camps 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Drug  Treatment  in  Jail 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Jail  Diversion  for  Mentally  III  Offenders 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Life  Skills  Education  Programs  for  Adults 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Restorative  Justice  for  Lower-Risk  Adult  Offenders 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Sex  Offender  Community  Notification  and  Registration 

June  2009 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

Sex  Offender  Treatment 

October  2006 

See  Drevious  WSIPP  oublication  for  Dast  findinas. 

4 


Exhibit  1 

Monetary  Benefits  and  Costs  of  Evidence-Based  Public  Policies 

Summary  of  policy  topics  assigned  to  the  Washington  State  Institute  for  Public  Policy  by  the  Washington  State  Legislature 

Estimates  for  Washington  State ,  as  of  April  2012 


Topic  Area/Proaram 

Last 

Monetary  Benefits 

Costs 

Summary  Statistics 

Benefits  and  costs  are  life-cycle  present-values  per  participant,  in  201 1 

Updated 

Total 

Taxpayer 

Non- 

Benefits 

Benefit  to 

Measured 

dollars.  The  programs  are  listed  by  major  topic  area,  although  some 

Benefits 

Taxpayer 

Minus 

Cost 

Risk 

programs  achieve  benefits  in  multiple  areas.  Also,  some  programs  achieve 

Costs 

Ratio1 

(odds  of  a 

benefits  that  we  cannot  monetize;  see  linked  documents  for  program- 

(net  present 

positive  net 

specific  details. 

value) 

present  value) 

Child  Welfare 

Nurse  Family  Partnership  for  Low-Income  Families 

April  2012 

$22,781 

$6,219 

$16,562 

($9,600) 

$13,181 

$2.37 

80% 

Parent  Child  Interaction  Theraov  (PCIT1  for  Families  in  the  Child  Welfare 

System 

April  2012 

$7,168 

$1,277 

$5,892 

($1,551) 

$5,617 

$4.62 

100% 

Intensive  Family  Preservation  Services  (Flomebuilders) 

April  2012 

$6,942 

$3,759 

$3,183 

($3,288) 

$3,655 

$2.11 

99% 

SafeCare 

April  2012 

$1,501 

$278 

$1,223 

($102) 

$1,399 

$14.65 

100% 

Parents  as  Teachers 

April  2012 

$4,992 

$1,116 

$3,876 

($4,227) 

$765 

$1.18 

57% 

Alternative  Response 

April  2012 

$852 

$257 

$595 

($96) 

$756 

$8.88 

100% 

Triple  P  Positive  Parentina  Proaram  (System) 

April  2012 

$865 

$334 

$531 

($143) 

$722 

$6.06 

100% 

Other  home  visitina  programs  for  at-risk  mothers  and  children 

April  2012 

$5,138 

$1,233 

$3,904 

($5,603) 

($465) 

$0.92 

44% 

Parent  Child  Flome  Program 

April  2012 

$3,920 

$1,082 

$2,838 

($5,496) 

($1,576) 

$0.71 

38% 

Healthv  Families  America 

April  2012 

$2,589 

$1,165 

$1,424 

($4,601) 

($2,011) 

$0.56 

26% 

Other  Family  Preservation  Services  (non-Flomebuilders) 

April  2012 

($902) 

($208) 

($693) 

($3,046) 

($3,948) 

($0.30) 

0% 

Child  welfare  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 

Family  Team  Decision  Makinq 

April  2012 

See  linked  dccument  for  meta-analytic  results. 

Structured  Decision  Makinq  Risk  Assessment 

April  2012 

See  linked  document  for  meta-analytic  results. 

Dependency  (or  Family  Treatment)  Drug  Courts 

July  2008 

See  previous  WSIPP  publication  for  past  findinos;  update  in 

process. 

Flexible  Funding  via  Title  IV-E  Waivers 

July  2008 

See  previous  WSIPP  publication  for  past  findinos. 

Subsidized  Guardianship 

July  2008 

See  previous  WSIPP  publication  for  past  findinos. 

Circle  of  Security 

Too  few  rigorous  evaluations 

Project  KEEP 

Too  few  rigorous  evaluations 

Promoting  First  Relationships 

Too  few  rigorous  evaluations 

Pre-K  to  12  Education 

Readina  Recovery  (K-12  Tutorina) 

April  2012 

$18,603 

$4,410 

$14,194 

($1 ,895) 

$16,708 

$9.82 

100% 

Earlv  Childhood  Education  for  Low  Income  3-  and  4-Year  Olds 

April  2012 

$22,457 

$6,802 

$15,655 

($7,523) 

$14,934 

$2.99 

100% 

K-12  Tutorina  bv  Peers 

April  2012 

$12,273 

$2,904 

$9,369 

($1,016) 

$11,257 

$12.08 

100% 

Tutorina  (vs.  No  Tutorina)  for  Enalish  Lanauaae  Learner  Students 

April  2012 

$10,938 

$2,598 

$8,341 

($1 ,362) 

$9,576 

$8.03 

85% 

SDecial  Literacy  Instruction  for  Enalish  Lanauaae  Learner  Students 

April  2012 

$6,969 

$1,652 

$5,317 

($282) 

$6,688 

$24.75 

90% 

K-12  Tutorinq  by  Adults 

April  2012 

$6,683 

$1,586 

$5,097 

($1 ,992) 

$4,691 

$3.36 

93% 

Teacher  Induction  Proqrams 

April  2012 

$3,648 

$866 

$2,783 

($63) 

$3,585 

$57.79 

88% 

K-12  Parent  Involvement  Proqrams 

April  2012 

$3,575 

$850 

$2,725 

($836) 

$2,739 

$4.28 

68% 

National  Board  for  Professional  Teachina  Standards  (NBPTS) 

Certification  Bonuses 

April  2012 

$1,802 

$428 

$1,374 

($69) 

$1,734 

$26.28 

100% 

Teacher  Performance  Pav  Programs 

April  2012 

$295 

$69 

$225 

($34) 

$261 

$8.62 

63% 

Additional  Day  of  K-12  Instructional  Time 

April  2012 

$86 

$20 

$65 

($27) 

$59 

$3.18 

59% 

K-12  Educator  Content-Specific  Professional  Development 

April  2012 

$19 

$4 

$14 

($6) 

$12 

$3.01 

52% 

K-12  Educator  Professional  Development  (Non-Content  Specific) 

April  2012 

($1) 

($0) 

($0) 

($6) 

($7) 

($0.11) 

48% 

Even  Start 

April  2012 

($1,257) 

($296) 

($961) 

($4,126) 

($5,383) 

($0.30) 

14% 

Earlv  Flead  Start 

April  2012 

$2,264 

$1,516 

$748 

($10,420) 

($8,156) 

$0.22 

17% 

Pre-K  to  12  education  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 

Pre-K  and  Elementary  Bilinqual  Instructional  Proqrams  (vs.  Enqlish-based)  for 

Enqlish  Lanquaqe  Learners 

April  2012 

See  linked  document  for  meta-analytic  results. 

K-12  Teachers— ImDact  of  Havino  a  Graduate  Decree 

April  2012 

See  linked  document  for  meta-analytic  results. 

K-12  Teachers— ImDact  of  Havino  an  In-subiect  Graduate  Decree 

April  2012 

See  linked  document  for  meta-analytic  results. 

K-12  Teachers — Effectiveness  bv  Years  of  Experience 

April  2012 

See  linked  document  for  meta-analytic  results. 

Class  Size 

March  2007 

See  Drevious  WSIPP  oublication  for  Dast  findinos. 

Full-Day  Kindergarten  (vs.  half-day) 

March  2007 

See  Drevious  WSIPP  oublication  for  Dast  findinos. 

Increased  Per-Student  Expenditures 

December  2007 

See  Drevious  WSIPP  oublication  for  Dast  findinos. 

5 


Exhibit  1 

Monetary  Benefits  and  Costs  of  Evidence-Based  Public  Policies 

Summary  of  policy  topics  assigned  to  the  Washington  State  Institute  for  Public  Policy  by  the  Washington  State  Legislature 

Estimates  for  Washington  State ,  as  of  April  2012 


Topic  Area/Proaram 

Last 

Monetary  Benefits 

Costs 

Summary  Statistics 

Benefits  and  costs  are  life-cycle  present-values  per  participant,  in  201 1 
dollars.  The  programs  are  listed  by  major  topic  area,  although  some 
orograms  achieve  benefits  in  multiple  areas.  Also,  some  programs  achieve 
oenefits  that  we  cannot  monetize;  see  linked  documents  for  program- 
specific  details. 

Undated 

Total 

Benefits 

Taxpayer 

Non- 

Taxpayer 

Benefits 
Minus 
Costs 
(net  present 
value) 

Benefit  to  Measured 
Cost  Risk 

Ratio1  (odds  of  a 

positive  net 
present  value) 

Children's  Mental  Health 

Coanitive  Behavioral  TheraDv  (CBT)-Based  Models  for  Child  Trauma 

April  2012 

$8,929 

$2,779 

$6,151 

$317 

$9,246 

n/e 

100% 

Remote  Coanitive  Behavioral  Theraov  (CBT)  for  Anxious  Children 

April  2012 

$7,653 

$2,265 

$5,388 

$741 

$8,393 

n/e 

96% 

Group  Coanitive  Behavioral  Therapy  (CBT)  for  Anxious  Children 

April  2012 

$7,247 

$2,143 

$5,104 

$393 

$7,640 

n/e 

98% 

individual  Coanitive  Behavioral  TheraDv  (CBT)  for  Anxious  Children 

April  2012 

$7,337 

$2,170 

$5,166 

($734) 

$6,603 

$10.00 

95% 

Eve  Movement  Desensitization  and  ReDrocessina  (EMDR)  for  Child 

Trauma 

April  2012 

$5,804 

$1,815 

$3,989 

$155 

$5,959 

n/e 

79% 

Parent  Coanitive  Behavioral  TheraDv  (CBT)  for  Anxious  Youna  Children 

April  2012 

$3,291 

$998 

$2,293 

$608 

$3,899 

n/e 

81% 

Coanitive  Behavioral  Therapy  (CBT)  for  Depressed  Adolescents 

April  2012 

$3,441 

$1,022 

$2,419 

($484) 

$2,957 

$7.11 

99% 

Brief  Strateaic  Family  Therapy  (BSFT) 

April  2012 

$3,112 

$965 

$2,147 

($512) 

$2,601 

$6.08 

69% 

Parent  Child  Interaction  TheraDv  (PCIT)  for  Children  with  Disruptive 

Behavior  Problems 

April  2012 

$3,385 

$1,120 

$2,265 

($1,335) 

$2,049 

$2.53 

100% 

Triple  P  Positive  Parentina  Proaram:  Level  4,  Individual 

April  2012 

$3,621 

$1,195 

$2,426 

($1 ,833) 

$1,788 

$1.98 

92% 

Thole  P  Positive  Parentina  Proaram:  Level  4,  Group 

April  2012 

$2,112 

$696 

$1,416 

($375) 

$1,737 

$5.63 

100% 

Multisvstemic  Therapy  (MST)  for  Youth  with  Serious  Emotional 

Disturbance  (SED) 

April  2012 

$7,443 

$2,885 

$4,558 

($6,501) 

$942 

$1.14 

68% 

Behavioral  Parent  Trainina  (BPT)  for  Children  with  Disruptive  Behavior 

Disorders 

April  2012 

$768 

$252 

$516 

$105 

$873 

n/e 

68% 

Families  and  Schools  Toaether  (FAST) 

April  2012 

$2,610 

$775 

$1,834 

($1 ,759) 

$851 

$1.48 

52% 

Behavioral  Parent  Trainina  (BPT)  for  Children  with  ADHD 

April  2012 

$430 

$126 

$304 

$106 

$536 

n/e 

98% 

Incredible  Years:  Parent  Trainina 

April  2012 

$2,482 

$797 

$1 ,685 

($2,074) 

$408 

$1.20 

61% 

Incredible  Years:  Parent  Trainina  +  Child  Trainina 

April  2012 

$2,429 

$774 

$1 ,655 

($2,135) 

$295 

$1.14 

59% 

Multimodal  Theraov  (MMT)  for  Children  with  Disruptive  Behavior 

April  2012 

$656 

$222 

$435 

($1 ,274) 

($617) 

$0.52 

42% 

Coanitive  Behavioral  TheraDv  (CBT)  for  Children  with  ADHD 

April  2012 

($37) 

($8) 

($28) 

($985) 

($1,021) 

($0.04) 

3% 

Multimodal  Theraov  (MMT)  for  Children  with  ADHD 

April  2012 

$1 ,749 

$440 

$1,309 

($8,343) 

($6,593) 

$0.21 

11% 

Children's  mental  health  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 

Intensive  Case  Management  (Wraparound)  for  Youth  with  Emotional  Disturbance 

July  2008 

See  Drevious  WSIPP  oublication  for  Dast  findings. 

General  Prevention  Programs  for  Children  and  Adolescents 

Youth  Mentorina  Proarams  (taxpayer  costs  only) 

April  2012 

$7,207 

$1,958 

$5,249 

($1 ,479) 

$5,728 

$4.87 

61% 

Good  Behavior  Game 

April  2012 

$4,790 

$1,337 

$3,454 

($154) 

$4,637 

$31.19 

100% 

Quantum  Opportunities  Proqram 

April  2012 

$30,311 

$8,737 

$21 ,574 

($25,743) 

$4,568 

$1.18 

60% 

Youth  Mentorina  Proqrams 

April  2012 

$8,333 

$2,348 

$5,985 

($4,799) 

$3,534 

$1.74 

58% 

Seattle  Social  Development  Project 

April  2012 

$5,804 

$1,686 

$4,118 

($3,026) 

$2,779 

$1.92 

59% 

Guidina  Good  Choices 

April  2012 

$2,540 

$598 

$1,942 

($870) 

$1,670 

$2.92 

85% 

Behavioral  Monitorina  and  Reinforcement  Proaram 

April  2012 

$1,995 

$531 

$1 ,463 

($1 ,276) 

$719 

$1.56 

58% 

Promotina  Alternative  Thinkina  Strateaies  (PATHS) 

April  2012 

($19) 

($6) 

($13) 

($115) 

($134) 

($0.17) 

23% 

Strenathenina  Families  for  Parents  and  Youth  10-14 

April  2012 

$696 

$213 

$483 

($1 ,077) 

($381) 

$0.65 

7% 

Children's  Aid  Societv-Carrera 

April  2012 

$7,184 

$2,381 

$4,802 

($14,220) 

($7,036) 

$0.51 

37% 

CASASTART 

April  2012 

($1 ,574) 

($385) 

($1,188) 

($6,806) 

($8,380) 

($0.23) 

0% 

Fast  Track  prevention  proaram 

April  2012 

$1,953 

$450 

$1,503 

($58,747) 

($56,794) 

$0.03 

0% 
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Topic  Area/Proaram 

Last 

Monetary  Benefits 

Costs 

Summary  Statistics 

Benefits  and  costs  are  life-cycle  present-values  per  participant,  in  201 1 
dollars.  The  programs  are  listed  by  major  topic  area,  although  some 
programs  achieve  benefits  in  multiple  areas.  Also,  some  programs  achieve 
oenefits  that  we  cannot  monetize;  see  linked  documents  for  program- 
specific  details. 

Updated 

Total 

Benefits 

Taxpayer 

Non- 

Taxpayer 

Benefits 
Minus 
Costs 
(net  present 
value) 

Benefit  to  Measured 
Cost  Risk 

Ratio1  (odds  of  a 

positive  net 
present  value) 

Substance  Abuse 

Motivational  Interviewing  /  Motivational  Enhancement  TheraDv  for 

Alcohol  Abuse 

April  2012 

$9,164 

$1,926 

$7,238 

($206) 

$8,957 

$44.38 

100% 

Motivational  Interviewing  /  Motivational  Enhancement  TheraDv  for 

Smoking 

April  2012 

$7,949 

$295 

$7,654 

($206) 

$7,743 

$38.49 

99% 

Brief  Alcohol  Screening  and  Intervention  for  College  Students  (BASICS) 

April  2012 

$3,110 

$771 

$2,339 

($226) 

$2,883 

$13.75 

97% 

Motivational  Interviewing  /  Motivational  Enhancement  TheraDv  for 

Cannabis  Abuse 

April  2012 

$2,388 

$691 

$1,697 

($206) 

$2,182 

$11.58 

100% 

Motivational  Interviewing  /  Motivational  Enhancement  TheraDv  for 

Illicit  Drug  Abuse 

April  2012 

$2,023 

$593 

$1 ,430 

($207) 

$1,816 

$9.78 

97% 

Life  Skills  Training 

April  2012 

$1,290 

$289 

$1,001 

($34) 

$1,256 

$37.52 

100% 

Proiect  Towards  No  Drug  Abuse  (TND) 

April  2012 

$123 

$31 

$92 

($14) 

$109 

$8.61 

76% 

Proiect  STAR 

April  2012 

$582 

$151 

$431 

($489) 

$93 

$1.19 

71% 

Proiect  ALERT 

April  2012 

$7 

$2 

$5 

($145) 

($138) 

$0.05 

1% 

Substance  abuse  prevention  and  treatment  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 


All  Stars 
DARE 

Minnesota  Smoking  Prevention  Program 

Project  Northland 

Project  Towards  No  Tobacco  Use 


July  2004 
July  2004 
July  2004 
July  2004 
July  2004 


See  previous  WSIPP  publication  for  past  findings. 
See  previous  WSIPP  publication  for  past  findings. 
See  previous  WSIPP  publication  for  past  findings. 
See  previous  WSIPP  publication  for  past  findings. 
See  previous  WSIPP  publication  for  past  findings. 


Adult  Mental  Health 

Cognitive  Behavioral  Therapy  (CBT)  for  Adult  Anxiety 

Cognitive  Behavioral  Therapy  (CBT)  for  Adult  Depression 


April  2012 
April  2012 


$17,731  $4,938  $12,793  ($341)  $17,390  $52.01  97% 

$15,632  $4,619  $11,013  ($227)  $15,405  $68.90  100% 


Adult  mental  health  treatment  programs  for  which  we  have  not  calculated  benefits  and  costs  (at  this  time): 


Day  Programs  for  Mentally  III  Adults 
Remote  Cognitive  Behavioral  Therapy 
Treatments  for  Post-Traumatic  Stress  Disorder 
Eye  Movement  Desensitization  and  Reprocessing 
Primary  Care  Interventions  for  Depression 


Review  in  process. 
Review  in  process. 
Review  in  process. 
Review  in  process. 
Review  in  process. 


Public  Health 

See  Technical  Appendix  I  for  meta-analytic  results  for  prevention  programs  targeting  teen  pregnancy  and  obesity. 
We  have  not  have  not  completed  our  computation  of  benefits  and  costs  for  these  programs. 


Teen  Pregnancy  Prevention: 

Postponing  Sexual  Involvement  April  2012 

School-Based  Service  Learning  April  2012 

School-based  Sexual  Education  April  2012 

Teen  Outreach  Program  April  2012 

Adolescent  Sibling  Pregnancy  Prevention  April  2012 

Obesity  Prevention: 

School  programs  for  healthy  eating  to  prevent  obesity  April  2012 

School  programs  for  physical  activity  to  prevent  obesity  April  2012 

School  programs  for  healthy  eating  &  physical  activity  to  prevent  obesity  April  2012 


See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 

See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 
See  linked  document  for  meta-analytic  results. 


Obesity  prevention  programs  for  which  we  have  not  calculated  meta-analytic  results  (at  this  time): 

Early  child  care  centers  &  homes  nutrition  &  physical  activity  programs  Too  few  rigorous  evaluations. 

Taxes  on  sweetened  beverages  and  snack  food  Too  few  rigorous  evaluations. 

Nutrition  labeling  on  menus  &  posting  nutritional  information  Too  few  rigorous  evaluations. 
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Housing 

See  Technical  Appendix  I  for  meta-analytic  results  for  housing  programs  for  offenders  returning  to  the  community  and  adults  with  mental  illness. 
We  have  not  have  not  completed  our  computation  of  benefits  and  costs  for  these  programs. 

Housing  Supports  for  Offenders  Returning  to  the  Community  April  2012  See  linked  document  for  meta-analytic  results. 

Housing  Support  for  Adults  With  Mental  Illness  April  2012  See  linked  document  for  meta-analytic  results. 

Housing  Supports  for  Serious  Violent  Offenders  April  2012  See  linked  document  for  meta-analytic  results. 


Notes  to  Exhibit  1 

1  Benefit  to  cost  ratios  cannot  be  computed  in  every  case;  we  list  "n/e"  for  those  that  cannot  be  reliably  estimated. 
'  Institutions  =  state  institutionalized  juvenile  justice  populations 


Summary  Statistics 


Benefits 

Benefit  to 

Measured 

Minus 

Cost 

Risk 

Costs 

Ratio1 

(odds  of  a 

(net  present 

positive  net 

value) 

present  value) 

Tonic  Area/Proaram 

Last 

Monetary  Benefits 

Costs 

Benefits  and  costs  are  life-cycle  present-values  per  participant,  in  201 1 
dollars.  The  programs  are  listed  by  major  topic  area,  although  some 
programs  achieve  benefits  in  multiple  areas.  Also,  some  programs  achieve 
benefits  that  we  cannot  monetize;  see  linked  documents  for  program- 
specific  details. 

Undated 

Total 

Benefits 

Taxpayer  Non- 

Taxpayer 

For  further  information,  contact  Stephanie  Lee  at 

slee@wsipp. wa.gov  Document  No.  12-04-1201 


■  Washington  State 
Institute  for 
Public  Policy 

The  Washington  Legislature  created  the  Washington  State  Institute  for  Public  Policy  in  1983.  The  Institute  is  governed  by  a  Board  of  Directors  that 
represents  the  legislature,  governor,  and  public  universities.  The  Board  guides  the  development  of  all  Institute  activities.  The  mission  of  the  Institute  is 
to  assist  policymakers,  particularly  those  in  the  legislature,  in  making  informed  judgments  about  important,  long-term  issues  facing  Washington  State. 
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